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The  application  of  the  sequential  moderation  test  to  issues  associated  with 
dynamic  criteria  is  discussed. 


Moderator 


2 


Tests  of  Parallelism  in  Subgrouping  Moderator  Analysis  and 
Sequential  Moderation 

Subgrouping  moderator  analysis  has  been  employed  extensively  in 
Industrial/Organizational  psychology.  This  procedure  involves  typically 

(a)  the  sorting  of  a  heterogenec  s  sample  into  more  homogeneous  subgroups, 
where  the  variable  used  for  sorting  purposes  is  referred  to  as  a  moderator 
(e.g.,  male  versus  female;  high,  middle,  low  socioeconomic  status),  and 

(b)  comparisons  of  relationships,  based  on  variables  other  than  the  mod¬ 
erator,  among  the  subgroups  (Zedeck,  1971).  A  significant  difference  in 
relationships  among  the  subgroups  suggests  that  the  magnitude  of  any  partic¬ 
ular  relationship  is  dependent  on  the  subgroup  in  which  it  was  calculated. 
Given  significant  differences,  it  is  often  said  that  the  moderator  "moder¬ 
ated"  the  relationships. 

Another  form  of  moderation  is  sequential  moderation  (cf.  Weitz,  1966; 
Zedeck,  1971).  An  illustration  of  sequential  moderation  is  the  comparison 
of  predictor-criterion  relationships  for  the  same  subjects,  given  the  same 
predictor  scores  and  repeated  measurements  on  a  criterion.  For  example,  it 
might  be  found  that  the  selection  tests  that  predict  job  performance  six 
months  after  hire  are  not  the  same  tests  as  those  that  predict  job  perform¬ 
ance  twelve  months  after  hire.  Results  such  as  these  suggest  that  the  mag¬ 
nitude  of  a  predictor-criterion  relationship  for  a  particular  predictor  is 
dependent  on  the  time  of  measurement  of  the  criterion.  The  moderator  in 
this  illustration  is  time,  although  the  true  moderator  may  be  changes  in 
organizational  demands  or  abilities  used  (Smith,  1976),  and  the  analytic 
question  is  whether  predictor-criterion  relationships  change  (differentially) 
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as  a  function  of  time.  Sequential  moderation  has  not  been  emploved  fre¬ 
quently,  although  its  potential  contribution  to  longitudinal  studies  of 
psychological  processes  is  clearly  evident. 

The  objective  of  this  article  is  to  present  analytic  procedures  for 
subgrouping  moderator  analysis  and  sequential  moderation  based  on  tests 
of  "parallelism  of  regressions."  With  respect  to  subgrouping  moderator 
analysis,  the  question  addressed  is  whether  unstandardized  regression 
weights  (b^-weights) ,  determined  by  separate  regressions  of  one  or  more  cri¬ 
teria  on  one  or  more  predictors  in  each  subgroup,  differ  significantly  among 
the  subgroups.  Procedures  are  discussed  also  for  multiple  comparisons  (when 
more  than  two  subgroups  are  involved)  and  for  ascertaining  the  relative  con¬ 
tribution  of  a  predictor  to  the  overall  differences  in  b-weights  among  the 
subgroups.  With  respect  to  sequential  moderation,  a  test  is  presented  for 
assessing  the  equality  of  ^-weights  over  time,  given  the  same  subjects,  same 
predictor  scores,  and  repeated  measurements  on  a  criterion  variable.  Anal¬ 
ytic  procedures  are  discussed  separately  for  subgrouping  moderator  analysis 
and  sequential  moderation.  Empirical  illustrations  are  presented  for  each 
procedure. 


Subgrouping  Moderator  Analysis 
Need  for  New  Approaches 

A  review  of  recent  articles  from  the  job  characteristic  and  role  per¬ 
ception  literatures  illustrates  problems  associated  with  subgrouping  moder¬ 
ator  analytic  procedures  presently  in  use.1  Figure  1  displays  an  analytic 
design  not  unlike  many  found  in  these  studies /reviews,  where  A  is  the  moder¬ 
ator  variable  that  defines  the  subgroups  (e.g.,  urban  versus  rural  background). 
In  Figure  1,  the  typical  statistical  procedure  is  to  compare,  separately. 
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pairwise  correlation  coefficient  (e.g.,  r  vs.  r  ,  r  vs.  r  ,  and 

111  112  121  122 

so  forth),  which  in  this  illustration  would  result  in  a  series  of  six  univariate 
^-tests  (three  for  each  criterion).  Results  of  the  six  tests  are  then  usually 
discussed  with  respect  to  whether  A  is  a  moderator  for  (a)  some  predictor- 
criterion  relationships  but  not  other  predictor-criterion  relationships  in 
regard  to  each  criterion,  and  (b)  overall  predictor-criterion  relationships 
for  some  criteria  but  not  others  (e.g.,  A  moderates  X,  Y  relationships  for 
Y  but  not  Y  ).  In  cases  where  more  than  two  subgroups  are  involved,  the 

JL  _2 

approaches  have  been  either  to  contrast  only  two  subgroups,  typically  extreme 

subgroups  (e.g.,  top  vs.  bottom  quartiles),  or  to  contrast  all  possible  pairs 

of  subgroups.  In  either  case,  the  analysis  is  again  based  on  a  series  of 
2 

univariate  t-tests. 


Insert  Figure  1  about  here 


Problems  with  the  analytic  procedures  described  above  include,  but  are 
not  necessarily  limited  to,  the  following. 

(1)  It  has  been  well-documented  that  comparisons  of  correlation  coeffi¬ 
cients  across  independent  subgroups  is  a  potentially  hazardous  procedure  if 
standard  deviations  on  the  variables  differ  among  subgroups  (cf.  Blalock,  1964; 
Gulliksen  &  Wilks,  1950;  Linn,  1978;  Tukey,  1964).  The  preferred  approach  is 

to  employ  b-weights  (cf.  Linn,  1978;  Tukey,  1964).  However,  when  multiple, 

correlated  predictors  are  involved,  a  simple  conversion  of  r-coef f icients  to 
bivariate  b-weights  will  not  suffice  because  the  predictors  do  not  operate 

independently.  The  same  point  applies  to  criteria  if  the  criteria  are  corre¬ 

lated.  Failure  to  consider  relationships  among  predictors  and  criteria  not 
only  may  lead  to  overestimation/underestimation  of  the  extent  of  moderator 
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effects,  but  also  fails  to  capitalize  on  the  increased  statistical  power 
that  is  potentially  achievable  by  employing  multivariate  procedures  (Winer, 
1971). 

(2)  It  is  straightforward  that  a  series  of  univariate  t^-tests  compounds 
the  probability  of  making  a  Type  I  error,  especially  given  that  the  same 
criterion  data  are  employed  in  more  than  one  test. 

(3)  Comparisons  based  on  extreme  subgroups  (e.g.,  high  vs.  low  quar- 
tiles  on  A)  may  suffer  not  only  from  the  two  problems  above,  but  also  from  a 
drop  in  statistical  power  resulting  from  using  only  part  of  the  overall 
sample  (cf.  Schmidt  &  Hunter,  1978),  as  well  as  the  inability  to  generalize 
findings  to  all  the  subpopulations. 

(4)  Comparisons  of  all  possible  combinations  of  subgroups  may  be 
vulnerable  to  problems  discussed  in  points  (1)  through  (3)  and  may  further 
compound  the  Type  I  error  as  a  result  of  the  increased  number  of  t>-tests 
conducted. 

In  summary,  since  the  problems  cited  are  representative  of  common  practice 
in  the  job  characteristic  and  role  perception  literatures  [as  well  as  in  other 
literatures  such  as  differential  validity  (cf.  Katzell  &  Dyer,  1977)],  it 
would  not  be  unreasonable  to  expect  that  these  literatures  contain  both 
Type  I  and  Type  II  errors.  If  anything,  we  have  probably  understated  the  case 
inasmuch  as  conclusions  are  often  drawn  regarding  the  efficacy  of  different 
moderators,  again  without  the  benefit  of  significance  tests. 

Without  belaboring  these  issues  further,  corrective  actions  for  the  four 
problems  discussed  above  are  proposed.  The  corrective  actions  consist  of 
analytic  procedures  in  which  controls  are  effected  for  Type  I  errors,  corre¬ 
lations  among  predictors  (and  criteria)  are  taken  into  account,  statistical 


m 
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power  is  believed  to  be  increased,  and  a  basis  is  provided  for  contrasting 
two  or  more  subgroups  simultaneously. 

Proposed  Analytic  Procedures 

Univariate  tests.  An  illustration  of  the  first  model  to  be  addressed  is 
presented  in  Figure  2.  In  this  figure,  there  are  K  independent  subgroups 
(i.e. ,A  defines  K  independent  subgroups,  which  is  represented  statistically 
by  k  -  1,  ...  ,  K),  J  predictors  (j_  *  1,  ,  J^) ,  and  one  criterion  (Y^) . 

The  are  are  b-weights,  determined  by  separate  multiple  regressions  of 

Y^  on  the  J  predictors  in  each  of  the  subgroups.  (Note  that  the  use  of  mul¬ 
tiple  regression  takes  into  account  the  covariances  among  the  X^  in  each 

subgroup).  The  question  to  be  asked  is  whether  a  significant  difference 
exists  among  the  b-weights  across  the  K  subgroups.  The  null  hypothesis  is: 

Hq  :  *  T2  *  *  ...  *  rK  ,  where  each  is  a  column  vector  of  subpopu¬ 

lation  b-weights  resulting  from  the  regression  of  on  the 

in  subpopulation  k. 


Insert  Figure  2  about  here 


The  logic  of  the  test  is  that  if  Hq  cannot  be  rejected,  then  a  common 

set  of  b-weights  can  be  applied  to  all  K  subgroups  without  affecting  signi¬ 
ficantly  the  pooled  residual  sum  of  squares  for  predicting  Y^as  compared 
to  the  pooled  residual  sum  of  squares  obtained  by  determining  the  b^-weights 
uniquely  for  each  subgroup  (Timm,  1975).  Consequently,  the  significance 

test  can  be  viewed  as  (a)  a  test  of  differences  between  Bc  and  uniquely  de- 
(  ~ 
termined  B^,  where  Bc  is  an  (estimated)  vector  of  b-weights  common  to  all 


Moderator 


7 


subgroups  (T  )  and  the  B  are  estimates  of  the  I',  ;  or  (b)  the  degree  to 

which  the  pooled  residual  sum  of  squares  is  increased  bv  using  a  common 
regression  equation  to  predict  in  all  subgroups  versus  employing  unique 
regression  equations  for  each  subgroup.  If  the  significance  test  leads  to 
rejection  of  the  null  hypothesis,  then  a  common  B^  should  not  be  applied 
in  all  K  subgroups.  This  implies  directly  that  not  all  of  the  r  are  equal, 
which  in  turn  suggests  that  A  may  be  regarded  as  a  moderator,  where  moder¬ 
ation  is  indicated  by  unequal  b-weight  vectors  (the  question  of  intercepts 
is  addressed  later  in  this  article). 

The  required  significance  test  is  presented  in  many  advanced  statistical 
texts  as  a  test  of  parallelism  of  regression  slopes,  planes,  or  hyperplanes; 
the  term  "heterogeneous  regression"  is  also  employed  [cf.  Finr  (1974,  pp.377- 

378);  Rao  (1965,  pp. 237-240);  Timm  (1975,  pp. 331-347);  Velicer  (  1972) ;  Williams 

3 

(1959,  chapter  8)]  .  That  is,  the  null  hypothesis,  T  =  r  =  T ,  =  . . .  =  r  ls 

1  2  _Jy  __k 

tested  by  ascertaining  whether  the  sample  estimates  of  the  ,  the  ,  are 

parallel  (across  subgroups) .  The  test  is  predicated  on  determining  whether 

one  B  can  be  used  in  place  of  the  separate  B  *  ,  as  discussed  above.  Given 
C  K 

the  rather  extensive  treatments  of  the  test  in  several  of  the  references  (see 
especially  Timm) ,  as  well  as  the  fact  that  the  test  is  the  same  as  that  em¬ 
ployed  in  analysis  of  covariance  to  test  the  assumption  of  common  regression 
slopes  (cf.  Tatsuoka,  1971,  pp. 40-60),  only  the  significance  test  itself  is 
presented.  The  form  of  the  test  we  have  employed  is  presented  in  Timm 
(1975,  p.335),  and,  for  sample  data,  is  as  follows: 


F 


B  )  S  /  J  (K-l) 

-S-  xyk  /  ~  ~ 


B.  7  SS  B,  )  /  (N  -  J  K  -  K) 
k  xxk  _k  — - — 


(1) 
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where: 

is  a  (column)  vector  of  unique  ^-weights  determined  by  multiple  regression 
in  subgroup  k  (primes  connote  the  transpose); 

S  is  a  column  vector  of  sum  of  cross-products  between  y  and  the  x  in 

1  -I 


subgroup  k  (lower-case  y  and  x  represent  deviation  scores); 
is  the  sum  of  squares  of  y  in  subgroup  k; 

is  the  sum  of  squares  and  cross-products  (SSCP)  matrix  of  the  x. 


predictors  in  subgroup  k; 


-1 


B  is  a  (column)  vector  of  common  b-weights,  obtained  bv  (1  SS  )  (£  S  ); 

_£  “  k  xxk  k  x\ 


and 

N  is  the  total  number  of  subjects  across  all  subgroups;  K  is  the  total 
number  of  subgroups,  and  J_  is  the  number  of  predictors. 

Prior  to  division  by  degrees  of  freedom,  the  numerator  of  Equation  1 
indicates  the  extent  to  which  the  pooled  residual  sum  of  squares  is  increased 
by  employing  B  for  all  subgroups  rather  than  the  unique  B,  for  each  subgroup. 

C  iC 

The  denominator  indicates  the  pooled  residual  sum  of  squares  resulting  from 

using  the  unique  B^  in  each  subgroup.  The  question,  therefore,  is  whether 

error  in  the  prediction  of  Y  based  on  the  X.  is  increased  significantly  by 

1 

employing  B^  rather  than  the  separate  B^,  in  relation  to  the  error  made  by 
using  only  the  B^  .  The  F-test  has  J(K-l)  and  (N-JK-K)  degrees  of  freedom, 
and,  to  employ  the  test,  it  is  assumed  that  the  residuals  (errors)  are  nor¬ 
mally  distributed  in  the  subpopulations.  As  noted  above,  a  significant  ]?-test 
indicates  that  not  all  of  the  are  equal,  and  further  suggests  that  A 
moderates  the  X.,  Y  relationships. 

If  the  F-test  presented  in  Equation  1  is  significant,  then  it  may  be  of 
interest  to  ascertain  whether  a  particular  predictor  contributed  significantly 
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to  overall  moderation  among  the  subgroups.  For  example,  review  of  the 
b-weights  might  indicate  that  predictor  X  in  Figure  2  wis  a  major  contrib¬ 
utor  to  overall  moderation.  Consequently,  the  investigator  may  wish  to 
compare  the  b-weights  for  X^  separately.  The  null  hypothesis  is:  : 


121 


Y  =  Y 
122  12k 


Y  i  where  the  y  are  subpopulation  para- 

_  _  12K  12k 

meters,  estimated  by  the  b  subgroup  weights.  A  significance  test  for  a 

12k 

"general"  predictor,  ,  presented  by  Williams  (1959,  p.132),  is  as  follows: 

2 


-J. 

2  [  (b  ,  -  b, J  /  S 


JJ 


ilk 


SXk 


]  /  (K-l) 


(2) 
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where : 


the  b are  the  separate  ^-weights  for  criterion  Y^  and  predictor  5C^  across 

the  subgroups  (based  on  the  regressions  of  Y^  on  all  X.  in  each  subgroup), 
b^.  is  the  weighted  mean  of  the  b_k  weights,  determined  by 


sJj 

XXk' 


SJJ  )  /  (2  1/S-'-'  ); 


XXk 


-1 

is  the  diagonal  element  in  SS  ;  and 

**k 

£  is  the  residual  mean  square  presented  in  the  denominator  of  Equation  1. 

The  F-test  has  (K-l)  and  (N  -  JK  -  K)  degrees  of  freedom. 

Of  additional  interest  might  be  post  hoc,  multiple  comparisons  of  spec¬ 
ific  subgroups.  For  example,  suppose  K  =  4,  and  following  a  significant 
_F-test  based  on  Equation  1  and  review  of  the  b-weights  in  each  subgroup, 

it  is  decided  that  differences  in  the  b-weights  for  the  A  and  A  subgroups 

~  1  4 

were  primarily  responsible  for  the  overall  differences  among  the  four  sub¬ 
groups.  An  F-test  for  the  difference  between  the  B  and  B  sample  b-weight 

1  4 

vectors  follows,  in  part,  the  procedures  underlying  the  development  of 
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Equation  1.  That  is,  the  numerator  has  the  following  form: 


which  has  degrees  of  freedom.  B  in  Equation  3  is  a  vector  of  common 

C14 

b-weights  for  subgroups  and  A^,  and  is  obtained  by  the  equation  given 

for  B  ;  only  here  Jc  assumes  values  of  1  and  4  only.  Fo."  owing  the  general 

c 

logic  of  multiple  comparison  tests,  the  denominator  fo  testing  the  hypoth¬ 
esis  that  r  and  are  equal  is  the  same  as  that  for  Equation  1  (with  the 
same  degrees  of  freedom) . 

Of  concern  at  this  point  is  that  three  tests  of  significance  have  been 
described,  two  of  which  may  involve  more  than  one  test  (i.e.,  Equations  2 
and  3).  Corrections  for  the  possibility  of  compounding  Type  I  errors  are 
required.  In  this  respect,  rationale  presented  by  Specht  and  Warren  (1976, 
p.57,  fn.2)  regarding  comparisons  of  structural  equations  across  subgroups 
is  recommended.  This  rationale  consists  of  a  sequential  reduction  in  the 
alpha  levels  for  different  types  of  significance  tests.  Applying  this  logic 
to  the  present  discussion  suggests  that  the  alpha  level  for  the  overall 
test  of  parallelism  might  be  set  at  .05  (or  whatever  the  investigation 
deems  appropriate),  the  alpha  level  for  the  test  of  a  general  predictor 
(Equation  2)  set  at  .025,  and  the  alpha  level  for  the  multiple  comparison 
test(s)  set  at. 01 (the  order  of  the  latter  two  tests  is  arbitrary).  In 
addition,  with  respect  to  the  multiple  comparison  tests,  it  is  advisable 
to  adjust  further  the  alpha  level  for  each  test  in  order  to  insure  that  the 
alpha  level  for  the  set  of  tests  does  not  exceed  a  predetermined  level  (e.g., 
£  <  .01).  In  this  condition,  the  investigator  may  wish  to  employ  the  logic 
of  error  rates  (e.g.,  Winer,  1971)  to  set  the  alpha  level  for  each  multiple 
comparison  test.  Similar  logic  applies  to  more  than  one  test  based  on 
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Equation  2  inasmuch  as  Che  identification  of  one  or  more  general  predictors 
requires  an  a  posteriori  review  of  results. 

Multivariate  test.  The  presentation  thus  far  has  addressed  only  one 
criterion.  It  is  possible  to  include  more  rhan  one  criterion  in  the  test 
of  parallelism  for  independent  data  sets,  in  which  case  the  hypothesis  to 


be  tested  is  that  matrices  of  unstandardized  regression  weights  are  the  same 
for  all  X  subgroups.  That  is,  the  null  hypothesis  if  P^  =  f9  =  P^  =  ...  = 

,  where  the  T.  are  J  by  I  subpopulation  matrices  of  unstandardized  re- 
gression  weights.  In  the  sample  estimates  of  the  P^  ,  the  B^  ,  each  column 
of  each  matrix  represents  the  b-weights  for  the  regression  of  a  particular 
(i  ®  1,  ...  ,  l  criteria)  on  the  X^  predictors  in  the  kth  subgroup  (the 
Xj  are  the  same  for  each  criterion).  The  analog  of  Equation  1  for  the  over¬ 
all  test  of  parallelism  for  _I  criteria  across  K  subgroups  is  as  follows 


SS  is  the  SSCP  matrix  of  the  y.  criteria  in  subgroup  k; 


is  a  J  x  I  matrix  of  la-weights; 

SS  is  the  SSCP  matrix  of  the  x.  predictors  in  subgroup  k;  and 

vJ°K  ~A 

B  is  a  matrix  of  common  b-weights  (one  column  for  each  criterion) ,  obtained 
c  — 

by  (£  SS  )  (I  SS  ) ,  were  SS  is  the  x,  v  sum  of  cross-products 
k  k 

matrix  for  subgroup  k,  v" v  '  ~ 

The  numerator  in  Equation  A  is  the  determinant  of  an  error  SSCP  matrix, 


designated  Q_.  Q  is  an  estimate  of  the  pooled  residuals  for  the  criteria 
E  ‘E 


Moderator 

12 


after  each  Y^  is  regressed  on  the  in  each  of  JK  subgroups.  The  denomina¬ 
tor  of  Equation  4  is  the  determinant  of  the  sum  of  Q  and  a  hypothesis  SSCP 
matrix.  The  sum  is  designated  Q^,  ,  and  is  equivalent  to  an  estimate  of  the 
pooled  residuals  in  the  criteria  after  a  common  set  of  ^-weights  are  determined 
for  each  Y^  across  the  K  subgroups  (the  b-weights  for  a  particular  Y  are 
the  same  across  the  K  subgroups,  but  the  ^-weights  for  different  Y^  may  be 
different).  Division  of  Q_  by  Q  provides  Wilks'  lamba  criterion 
(j\),  which  can  be  tested  by  the  0  distribution  with  (I,  J  (K-l) ,  N  -  JK  -  K) 
degrees  of  freedom  (other  multivariate  test  criteria  may  also  be  employed). 

The  required  assumption  is  that  the  criterion  variables  have  an  underlying 
multivariate  normal  distribution  (in  the  subpopulations). 

If  a  significant  is  obtained,  the  investigator  may  wish  to  conduct 
tests  on  one  or  more  of  the  separate  Y^,  using  the  procedures  discussed  in 
Equations  1  through  3.  This  requires  additional  concern  for  Type  I  errors. 
Following  prior  logic,  a  sequential  decrease  in  alpha  levels  may  be  desirable, 
beginning  with  .05  for  the  overall  multivariate  test,  and  progressively 
smaller  alpha  levels  for  each  succeeding  test  or  set  of  tests. 

Empirical  illustration.  Data  were  created  and  used  to  provide  examples 

of  the  tests  in  Equations  1  through  4.  Created  data  were  employed  to  provide 

investigators  an  opportunity  to  check  computer  programs  against  a  full  set  of 
4 

empirical  data.  The  created  data  are  presented  in  Table  1,  and  consist  of 
three  subgroups,  two  criteria,  and  two  predictors,  with  an  n  of  15  in  each 
subgroup  (N5*^  n  =  45).  Descriptive  statistics  are  presented  at  the  bottom 
of  Table  1,  where  a  review  of  the  correlation  coefficients  and  multiple  cor¬ 
relations  displays  the  patterns  used  to  create  the  data.  With  respect  to 


the  first  criterion  (Y^) ,  the  salient  features  are  (a)  relatively  large  pre¬ 
dictor-criterion  relationships  in  subgroups  1  and  3,  and  comparatively  lower 
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predictor-criterion  relationships  in  subgroup  2;  and  (b)  a  disordinal 
interaction  between  subgroups  1  and  3,  where  the  predictor-criterion  rela¬ 
tionships  are  positive  in  subgroup  1  and  negative  in  subgroup  3.  In  regard 
to  the  second  criterion  (Y^),  the  pattern  of  relationships  is  the  same  as 
that  for  Y^;  the  difference  occurs  in  that  the  predictor-criterion  rela¬ 
tionships  are  smaller  in  magnitude  far  .  These  patterns  were  chosen  be¬ 
cause  they  ensured  (a)  at  least  moderate,  although  not  necessarily  significant, 
correlations  among  the  predictors  and  among  the  criteria  in  most  cases,  from 
which  multivariate  analysis  draws  its  power;  and  (b)  rejection  of  the  null 
hypothesis  of  parallelism  for  tests  involving  at  least  the  Y^  criterion, 
which  is  desirable  for  an  illustration.  Moreover,  correlations  of  the  mag¬ 
nitudes  presented  in  Table  1  are  not  unrealistic  given  ns  of  15,  although 
the  disordinal  interactions  (subgroup  1  versus  subgroup  3)  are  admittedly 
somewhat  illusional,  especially  for  Y^  . 

Insert  Table  1  about  here 

Statistical  information  required  to  conduct  the  tests  in  Equations  1 
through  4  is  shown  in  Table  2.  In  effect,  the  information  in  this  table  is 
required  for  some  aspect  of  the  multivariate  test  of  parallelism  (Equation  4) . 
However,  examination  of  selected  portions  of  the  matrices  also  provides  most 
of  the  data  for  the  univariate  tests.  For  example,  the  first  column  of  the 
SS  ,  B  ,  and  B  matrices  contains  data  required  to  conduct  the  univariate 

^.3cyk_  JL  sJL. 

test  of  parallelism  for  the  regression  of  Y^  on  and  X£  .  The  only  other 
information  required  is  the  SS  matrices  and  the  upper-left  portions  of 
the  SS  matrices  (i.e.,  the  S  s),  which  are  provided  in  the  table,  and 

-JZl  yyk 

the  degrees  of  freedom,  which  are  based  on  J  =  2,  K  =  3,  and  N  =  45  (_I  =  2 


for  the  multivariate  test).  Information  not  included  in  this  table  can  be 
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computed  directly  from  the  data  presented  (e.g.,  pooled  within~group  SSCP 

matrices).  Finally,  it  is  important  to  note  that  B  in  Table  2  is  identical 

c 

for  each  subgroup,  which  connotes  that  the  same  sets  of  weights  are  applied 
in  each  subgroup. 


Insert  Table  2  about  here 


Illustrative  results  of  the  tests  presented  in  Equations  1  through  4  are 

reported  in  Table  3.  Section  I  of  this  table  displays  the  results  of  the 

multivariate  test  of  parallelism  for  the  two  criteria , based  on  the  rationale 

discussed  in  the  development  of  Equation  4.  The  null  hypothesis  is  that  the 

three  subpopulation  (unique)  b-weight  matrices,  whose  estimates  are  seen  by 

the  three  B,  in  Table  2,  are  equal;  that  is  P  =  T  *  T  .  Equation  4  was 

1  2  3 


employed  to  estimate  the  two  SSCP  matrices,  Q  and  Q  ,  the  determinant 

h  0 


values  of  which  are  shown  in  Table  3.  Division  of 


by 


resulted 


in  a  A  equal  to  .63,  significant  at  the  .05  level  as  tested  by  the  U  distri¬ 
bution  with  (2,  4,  36)  degrees  of  freedom.  The  null  hypothesis  of  equal  15- 
weight  matrices  was  rejected;  however,  more  in-depth  analyses  are  needed  to 
ascertain  the  basis  for  rejection. 


Insert  Table  3  about  here 


Separate  tests  of  parallelism  for  each  criterion,  across  the  three  sub¬ 
groups,  are  exhibited  in  section  II  of  Table  3.  The  null  hypothesis  for  each 

test  was  T  *  T  =  T  (the  second  subscript  indicates  subgroup) .  For 
il  12  13 

example,  the  test  for  criterion  Y  (i=*l)  was  based  on  a  test  of  the  equality 

_1 

of  the  first  column  of  the  B^  matrices  in  Table  2,  which  are  the  sample 
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estimates  of  the  7 ^  •  The  actual  test  employed  is  given  in  Equation  1,  where 

each  of  the  columns  above  was  compared  to  column  1  of  the  Bc  matrices  in 

Table  2.  As  shown  in  Table  3,  the  null  hypothesis  was  rejected  for  Y  but 

_1 

not  Y  .  This  indicated  that  the  b-weight  vectors  were  nonparallel  across  the 
_2 

three  subgroups  for  criterion  Y  only.  Based  on  discussions  of  the  need  to 

_1 

protect  against  Type  I  error,  the  alpha  level  for  the  two  F-tests  was  set  at 
.025. 

Review  of  the  first  column  of  each  matrix  in  Table  2  suggested  that 

I/-XV 

the  X  predictor  contributed  to  the  rejection  of  the  hypothesis  of  parallelism 
_JL 

for  criterion  Y  .  To  test  this  hypothesis,  Equation  2  was  employed,  the  null 

JL 

hypothesis  being  y  „  ^  =  y  „  ^  =  y  „  ^  (i  =  Y  ,  j_  =  X  )  .  The  null  hypothesis 
was  rejected,  as  shown  in  section  III  of  Table  3.  The  alpha  level  for  this 
test  was  set  at  .01  based  on  the  logic  of  sequential  reduction  in  alpha  levels. 
No  further  correction  for  error  rates  was  initiated >  based  on  Fisher's  least 
significant  difference  approach  (Winer,  1971)  and  two  possible  tests  for  Y^. 

The  final  question  addressed  here  was  a  post  hoc  comparision  between 

subgroup  1  and  subgroup  3  based  on  the  unique  b-weight  vectors  for  Y 

_1 

Equation  3  was  employed  to  conduct  the  test,  and,  as  presented  in  section  IV 
of  Table  3,  the  null  hypothesis  that  the  b-weight  vectors  were  equal  was 
rejected.  The  alpha  level  employed  for  this  test  was  .0017;  a  per  experiment 
alpha  level  of  .005  was  protected  for  three  possible  comparisons  using  Fisher's 
least  significant  difference  approach  (less  conservative  tests  may  be 


desired) . 
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Sequential  Moderation 

The  issue  addressed  in  this  section  concerns  a  test  of  the  equality 

of  ^-weights  when  the  predictors  are  measured  at  a  base  time  period  (T  ) 

_0 

and  repeated  measurements  are  taken  later  on  the  same  criterion  variable 

at  times  T  through  T  ,  where  s^  is  the  subscript  for  the  time  of  measure- 
_1  _S 

ment  on  the  criterion  ( _s  =  1  ...  S^) .  The  possibility  that  the  h-weights 
might  change  differentially  over  time  is  illustrated  by  studies  of  the 
dynamic  nature  of  criteria  (Fleishman  6  Fruchter,  1960;  Fleishman  &  Hempel, 
1954;  Ghiselli,  1956;  Ghiselli  &  Haire,  1960;  Inn,  Hulin,  &  Tucker,  1972; 
MacKinney,  1967;  Smith,  1976).  As  reviewed  by  MacKinney  (1967),  the  nature 
of  the  requirements  for  job  performance  might  change  over  time.  These  changes 
may  be  a  function  of  changes  in  environmental  presses,  the  skills  required 
to  perform  the  job,  types  of  training  received,  and  so  forth.  It  is  reason¬ 
able  to  expect  that  if  the  requirements  for  job  performance  change,  then  the 
rank-order  of  individuals  on  a  job  performance  criterion,  such  as  quality  of 
work,  will  change  over  repeated  measurements  (at  different  times)  on  this 
criterion.  It  is  also  reasonable  to  expect  that  predictors  of  job  performance, 
such  as  selection  tests,  will  exhibit  different  relationships  with  job  per¬ 
formance  as  a  function  of  when  job  performance  is  measured. 

A  model  for  the  type  of  problem  discussed  above  is  shown  in  Figure  3, 
which  presents  ^-weight  vectors  (columns)  for  the  separate  regressions  of 
one  criterion  variable  on  the  same  £  predictors  (e.g.,  selection  tests)  on 
Si  different  occasions.  The  predictors  are  measured  at  a  base  period  only 

(T  ) ,  repeated  measurements  are  taken  on  the  criterion  at  times  1  through  S_, 

_0 

thus  providing  separate  Y  on  X  multiple  regressions  .  The  same  sample 
of  subjects  is  employed  in  each  of  the  £  regressions.  The  question  is 
whether  a  significant  difference  exists  among' the  b-weight  vectors  across 


A 
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the  £  different  time  periods.  A  significant  difference  in  the  b-weight 
vectors  suggests  that  predictor-criterion  relationships  are  moderated  by 
time,  which,  as  noted  earlier,  is  indicative  of  changes  in  rank-order  on 
the  criterion,  and  may  connote  changes  in  such  things  as  skill  requirements. 


Insert  Figure  3  about  here 


The  null  hypothesis  is  r  =  T  =r  «  ...  =  T  ,  where  it  is  understood 

_1  _2  _s  __S 

that  each  r  refers  to  an  unstandardized  regression  weight  vector  for  the 
s 

same  criterion  variable  (i.e. ,  same  scale  of  measurement)  assessed  at 
different  points  in  time.  The  approaches  presented  for  tests  of  independent 
sets  of  data  will  not  suffice  here  inasmuch  as  the  data,  and  thus  the  _b-weight 
vectors,  are  likely  correlated.  Specifically,  the  predictor  data  are  identical 
for  each  criterion,  and  the  criteria  are  presumably  correlated  over  time, 
although  these  correlations  need  not  be  of  large  magnitudes.  The  correlations 
among  the  b-weight  vectors  must  be  taken  into  account  in  the  same  sense  that 
correlation  among  means  must  be  considered  in  correlated  ^-tests.  In  fact, 
we  employed  the  logic  of  Hotelling's  T2  for  correlated  data  and  repeated 
measures  ANOVA  to  develop  the  test  presented  below.  To  our  knowledge,  this 
test  has  not  been  presented  previously,  although  we  benefitted  from  treat¬ 
ments  of  tests  for  correlated  data  presented  by  Carter  (1949),  Kullback  and 
Rosenblatt  (1957),  and  Williams  (1959),  and  from  derivations  pertaining  to 
the  analysis  of  multiple-cue. judgment  tasks  using  the  "Lens  Model"  approach 
(Castellan,  1973). 5 

The  discussion  of  determining  an  analytic  procedure  begins  with  Hotelling's 

T2  statistic  for  correlated  data,  which  may  be  viewed  as  comprising  a  hypothesis 

matrix,  Q  ,  which  takes  the  form: 

H 
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H 


(Y  -  Y  )  (Y  -  Y 
12  12 


(5) 


and  an  error  matrix,  Q  ,  which  takes  the  form: 

Q-/V  +  V  -  2C  \ 

JL  Y  Y  H 

V  1  2  12/ 


(6) 


Y^  and  Y2  are  vectors  of  means  based  on  repeated  measurements  on  a  set  of 
Y  variables  for  the  same  subjects,  V  indicates  variance,  and  C  indicates 
covariance. 


If  Y^  and  Y^  are  replaced  by  b-weight  vectors  resulting  from  the  regres¬ 
sions  of  the  Yg  on  the  same  for  the  same  subjects,  at  times  1  and 
2  ( si  =  1,  2),  Qy  in  Equation  5  is  transformed  into 


H 


-  B2)  (Bl  -  B2) 


(7) 


while  Q  in  Equation  6  is 
£ 


Qe  -l  +  vE 


-  2C 


B1B2 


(8) 


Note  that  the  Yg  must  be  based  on  the  same  scale  in  Equations  7  and  8  in 
order  for  the  comparison  of  Js-weights  to  be  meaningful.  It  is  not  necessary, 
however,  for  the  Yg  to  have  the  same  means  or  same  standard  deviations  across 
the  £>  time  periods. 

We  wish  now  to  employ  the  approach  of  using  common  regression  coeffi¬ 
cients  as  the  basis  for  testing  differences  among  the  correlated  b-weight 
vectors.  This  provides  the  opportunity  to  extend  the  analytic  design  to 
accommodate  more  than  two  b-weight  vectors  (i.e.,  more  than  two  measurements 

on  the  criterion).  The  multivariate  design  employs  Qu  to  represent  a  hypoth- 

n 

esis  SSCP  matrix,  and  Q  to  represent  a  residual  SSCP  matrix. 

£ 

Equation  7  was  employed  as  a  starting  point  to  design  Q  ,  but  using  the 

H 

AAAs 

difference  between  each  b-weight  vector  and  a  common  b-weight  vector  rather 
than  calculating  the  difference  between  two  b-weight  vectors  directly.  With 


A 
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two  b-weigh".  vectors,  Q  is  as  follows: 


qH  -  (Bl  -  Bc)  (B1  -  Bc)  +  <B2  -  Bc)  (B2  -  B  ) 


•\  -  V  -  V  m 

where  Bg  is  a  ^-weight  vector  for  criterion  Y  measured  at  time  s_  (s^  -  1,2), 

B  is  a  vector  of  b-weights  common  to  Y,  and  Y„,  and  the  order  of  the  Q 
_ £  _ 1  _ £  H 

matrix  is  J  by  .J.  Using  logic  similar  to  that  presented  for  the  tests  of 
independent  data,  if  a  common  can  be  applied  for  predicting  the  separate 
criterion  measurements  without  significantly  increasing  the  residuals,  then 
the  uniquely  determined  ^-weight  vectors  for  each  Yg  are  not  significantly 
different . 

A  straightforward  extension  of  Equation  9  allows  one  to  include  more 

than  two  measurements  on  the  criterion  in  the  development  of  Q  .  That  is, 

rl 

j,  may  assume  values  beyond  2.  The  key  question  now  is  how  to  determine  Bc 

for  two  or  more  repeated  measurements  on  Y.  For  illustrative  purposes, 

JJ  is  set  equal  to  3  to  demonstrate  the  calculation  of  B^. 

The  determination  of  B^  is  predicated  on  the  inverse  of  the  pooled 

(across  time)  X.  variance-covariance  (VC)  matrices,  postmultiplied  by  the 

J 

pooled  X.  ,  Xg  covariance  vectors.  In  matrix  form,  this  is 


B  =  Z  VC 
c  I  o  xx 


z  c 

s 


where  VC  is  the  X.  variance-covariance  matrix  associated  with  the  cnter- 
xx  j 

s  — 

ion  measured  at  time  s,  and  C  is  the  J  by  1,  X.  ,  Y  covariance  vector 

xyg  “  J.  _s 

for  the  criterion  measured  at  time  s.  However,  the  VC  matrices  are 

s 

identical,  which,  with  minor  manipulation  and  S  =  3,  provides  (the  subscript 


for  VC 


is  deleted) : 
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or,  in  general  terms 

Bc  =  1/S  a  B  )  (11) 

—  s  — 

In  other  words,  the  common  coefficient  for  each  X,  is  simply  the  average 

_ J- 

of  the  separate  regression  coefficients  associated  with  that  X^  for  each 
time  period. 

Equation  8  provided  the  base  for  calculating  the  residual  SSCP 
matrix  Q^,  .  In  general  form,  where  s[  may  assume  values  greater  than  2, 
Equation  8  generalizes  to  the  following: 


Q  =  I  Vn  -  2  I  CD  _  (for  s  <  £)  (12) 

-i  s  S<P  BcBn 


The  equation  above  is  expanded  below,  where  use  is  made  of  derivations 

presented  by  Finn  (1974)  and  Castellan  (1973).  The  expansion  reflects 

simplifications  resulting  from  the  fact  that  the  predictor  variance- 

covariance  matrices  (VC  )  and  SSCP  matrices  (SS  )  are  identical  at 

xx  xx 


_ ^  _  s 

each  time  of  measurement,  which  also  implies,  for  example,  that 
VCxx  =  VCx  x  ,  where  £  <  £  (i.e.,  j>  ■  s.  +  1,  ...  ,  S_,  which  applies 
only  to  the  second  term  on  the  right-side  of  Equation  12).  Moreover, 
these  identities  allowed  deletion  of  the  subscripts  for  the  predictor 
variance-covariance  and  SSCP  matrices.  The  expansion  is  as  follows. 


Vg  =  (1 

S 


-1 

w  u 

y  xx 
s  _ 


)  V  SS 

'  i»  « 


(13) 


where  R  2  is  the  squared  multiple  correlation  resulting  from  the 
ys 

regression  of  Y  on  the  X,  at  time  j>,  and  V  represents  the  variance  of 

— ys 
the  Y  criterion  measured  at  time  s. 
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'B  B 

__s.  P 


=  C 


B  VC  B  1  SS  (s  <  p) 

S  XX  p  I  XX  —  r- 


y  y  s  xx  p  I  xx 
SR  —  * - -V— _ 
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(14) 


where  C  represents  the  covariance  between  repeated  measures  on  the 

YsyP 

criterion,  with  £  <  £  ,  and  Bg  and  are  b-weight  vectors  for  the 

regressions  of  Y  on  the  at  times  s  and  £. 

Based  on  Equations  13  and  14,  0  may  now  be  viewed  as  follows. 

L 


l 

(1  -  R  2)  V  SS  -1 

-2  l 

(C  -  B  VC  B  )  SS  ‘ 1 

s_ 

y  y  xx 

S  S  y  - 

s<p 

y  y  s  xx  _ £  xx 

L- — _  J 

T.  (1-R  2)V  -  2  I  (  C  -B'vc  B 

s  yg  ys  1  ”  ” 


,  y  y  s  xx  p 

s<p\  ^Vp  —  w _ 


SS  (15) 
xx 


Q  in  Equation  15  is  of  order  J  by  ^J. 

A  multivariate  significance  test  has  the  following  form: 


A  = 


(16) 


%  +  QE 

which  follows  the  U  distribution  with  [  j$,  J  (j>-l),  (n-l)(S-l)  -  S  J] 
degrees  of  freedom,  given  that  the  values  on  the  variables  were  sampled 
from  an  underlying,  joint  multivariate  normal  distribution. 

A  significant  _A  indicates  that  the  b-weight  vectors  for  the  differ 
significantly  for  repeated  measurements  on  Y  over  _S  time  periods.  Given  a 
significant  A,  inspection  of  each  b-weight  vector  may  show  that  certain  pre¬ 
dictors  have  significant  relationships  with  the  criterion  at  one  time  period, 
while  other  predictors  have  significant  relationships  with  Y  at  a  different 
time  period.  These  results  would  be  consistent  with  the  logic  of  dynamic 
criteria  and  suggest  sequential  moderation.  However,  a  significant  A  might 
also  reflect,  in  part,  various  statistical  inadequacies  and  artifacts.  For 
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example,  the  predictors  may  have  differential  rates  of  stability  over  time, 
where  the  more  stable  predictors  would  have  a  greater  likelihood  of  being 
related  to  the  criterion  as  the  time  interval  between  predictor  <nd  criterion 
measurements  increased.  Moreover,  criterion  measurements  at  each  point  in 
time  may  not  be  equally  reliable,  which  could  lead  to  spurious  differences  in 
the  b-weight  vectors.  Thus,  one  must  be  careful  when  interpreting  the  results 
provided  by  Equation  16,  which  is  to  say  that  consideration  should  be  given 
to  both  substantive  issues  and  potential  statistical  bias. 

Empirical  illustration.  Created  data  were  employed  to  simulate  a 
sequential  moderation  design  and  to  illustrate  the  use  of  Equation  16.  The 
design  was  similar  to  Figure  3,  although  more  austere,  and  included  two 
predictors  (X  ,  X^)  measured  at  a  base  period  (T^  —  e.g.,  two  selection 
tests),  and  one  criterion  (Yg),  on  which  repeated  measurements  were  taken  at 
T^  and  (i.e.,  s^  »  1,2).  The  analytic  question  is  whether  the  b-weights 

for  the  on  and  X2  regression  differ  significantly  from  the  b-weights 

for  the  on  X^  and  X^  regression;  the  null  hypothesis  is  T^  = 

The  created  data  (n  ■  30)  are  presented  in  Table  4.  Means,  standard 
deviations,  and  correlations  among  the  variables  are  presented  in  section  I  of 
Table  5.  The  correlations  among  the  variables  reflect  the  simulated  design, 
where  Ca)  X^  and  X2  were  not  correlated  significantly,  (b)  Y^  and  Y2  had  a 
significant  but  moderate  correlation  (which  allowed  for  changes  in  rank-order 
on  the  criterion  over  time),  and  (c)  had  a  high  positive  relationship 

with  Y^  and  a  comparatively  lower  relationship  with  Y 2,  whereas  X2  had  a 
high  positive  relationship  with  Y2  and  a  comparatively  lower  relationship 
with  Y^  .  These  data  reflect  a  sequential  moderation  design  wherein  both 
the  criterion  and  the  salience  of  a  predictor  change  as  a  function  of  time. 
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which  in  turn  suggest  that  the  Y  on  X  regression  planes  for  Tj  and  T 
will  be  unequal  (i.e.,  nonparallel). 


Insert  Tables  4  and  5  about  here 


Statistical  information  required  to  conduct  some  aspects  of  the  test 

of  parallelism  presented  in  Equation  16  is  displayed  in  section  II  of 

Table  5.  It  is  important  to  note  that  the  VC  and  SS  matrices  are 

xx  xx 

the  same  for  T^  and  T^  (i.e.,  the  same  predictor  scores  are  employed  in 
both  time  periods),  the  (unique)  b-weight  vectors  (B^  and  B^)  imply  non¬ 
parallelism,  and  the  vector  of  common  b-weights  (B  )  is  based  on  the 
average  of  the  B^  and  vectors  (see  Equation  11).  (Exact  replication 
of  some  values  is  not  possible  due  to  round-off  error.) 

The  results  of  the  test  of  parallelism  are  shown  in  section  III  of 
Table  5.  Equation  15  was  used  to  estimate  Q  and  Equation  9  was  em¬ 


ployed  to  estimate  Q  .  Division  of 

H 


by 


^E  + 


provided  a 


_A  of  .04  (j)  <  .01),  which  indicated  rejection  of  the  null  hypothesis  of 
parallelism.  Thus,  the  results  implied  that  the  relationships  between 
the  criterion  and  the  two  predictors  were  a  function  of  the  time  of 
measurement  on  the  criterion:  that  is,  the  Y  on  X  regressions  were 
sequentially  moderated. 


Discussion 

Analytic  procedures  have  been  presented  which  cast  subgrouping  moderator 
analysis  and  sequential  moderation  in  the  roles  of  tests  of  parallelism 
of  regression  slopes,  planes,  and  hyperplanes.  With  respect  to  subgrouping 
moderator  analysis,  when  (separate)  regression  equations  are  to  be  compared 
across  independent  subgroups  for  one  or  more  criteria,  the  proposed  methods 
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provide  a  basis  for  (a)  comparing  multiple  subgroups  and  multiple  predictors 
simultaneously,  and  (b)  increasing  statistical  power,  in  relation  to  separate 
comparisons  of  each  predictor-criterion  relationship,  by  taking  into  consid¬ 
eration  covariances  among  the  variables,  although  this  statement  is  qualified 
below.  Procedures  for  more  in-depth  analyses  for  a  particular  criterion 
included  a  test  to  identify  a  general  or  salient  predictor  (i.e.,  a  predictor 
which  led  to  the  rejection  of  parallelism)  and  a  post  hoc  multiple  comparison 
test  for  comparing  the  regression  equations  of  two  subgroups.  Methods  for  pro¬ 
tecting  against  Type  I  errors  were  also  presented,  and  involved  sequential 
reduction  in  alpha  levels  and  the  use  of  error  rates.  It  is  noteworthy  that 
these  methods  might  result  in  potentially  severe  losses  of  power  for  tests  con¬ 
ducted  in  the  later  phases  of  an  analysis  (e.g.,  multiple  comparison  tests), 
especially  in  multivariate  designs  involving  three  or  more  subgroups.  In 
general,  this  is  the  price  one  must  pay  for  "data-snooping" ,  although  the 
methods  employed  in  this  paper  were  conservative  and  other  investigators  may 
wish  to  use  alternative  procedures. 

It  is  important  to  note  that  the  usual  caveats  associated  with  sub¬ 
grouping  moderator  analysis  apply  also  to  the  analyses  discussed  here.  The 
moderator  should  be  uncorrelated,  or  at  least  have  very  low  correlations, 
with  the  predictors  and  criteria;  the  reliabilities  of  all  variables  should 
be  within  acceptable  limits  and  highly  similar  across  different  subgroups; 
relationships  within  subgroups  should  be  linear;  differences  among  re¬ 
gressions  should  be  of  practical  as  well  as  statistical  significance,  espec¬ 
ially  if  large  samples  are  employed,  although  the  subgroup  sample  sizes 
should  i.i  any  case  be  of  sufficient  size  to  provide  meaningful  power  for  the 
tests;  and  cross-validation  of  results  is  strongly  recommended  (Abrahams  & 

Alf,  1972;  Guion,  1976;  Linn,  1978;  Schmidt  &  Hunter,  1977,  1978;  Schmidt 
et  al. ,  1976;  Zedeck,  1971).  Problems  associated  with  differential  range 
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restriction  across  subgroups  is  generally  not  a  problem  inasmuch  as  unstand¬ 
ardized  regression  weights  are  employed. 

It  should  also  be  mentioned  that  the  usual  caveats  apply  regarding 
the  use  of  multiple  regression  (cf.  Cohen  &  Cohen,  1975).  Of  particular 
concern  is  avoidance  of  problems  resulting  from  multicollinearity ,  namely 
the  "bouncing"  regression  weight  problem.  Moreover,  although  the  subgroup 
sample  sizes  may  "vary,  large  differences  in  sample  sizes  are  likely  to 
result  in  the  same  problem  associated  with  comparisons  of  means,  namely  a 
greater  probability  of  committing  a  Type  II  error. 

The  caveats  above  generally  apply  to  the  test  for  sequential  moderation, 
although  the  same  sample  of  subjects  is  required  to  conduct  this  test.  The 
sequential  moderation  test  was  designed  to  ascertain  whether  the  regressions 
of  a  criterion  on  a  set  of  predictors  could  be  considered  nonparallel  for 
repeated  measurements  on  the  criterion.  It  is  noteworthy  that  this  test 
does  not  provide  a  basis  for  causal  inference;  other  methods  are  required 
for  this  purpose.  Nevertheless,  descriptive  studies  of  changes  in  predictor- 
criterion  relationships  over  time  are  important,  especially  in  relation  to 
the  dynamic  nature  of  criteria  and  long-range  test  validity.  It  is  also 
important  to  reiterate  the  point  that  differences  in  relationships  over  time 
may  in  part  be  due  to  statistical  inadequacies  and  artifacts,  such  as  differ¬ 
ential  stabilities  among  the  predictors  or  differences  in  criterion  reliabil¬ 
ities  at  different  times  of  measurement.  Careful  consideration  should  be 
given  to  both  short-term  reliabilities  and  long-term  stabilities  in  tests  of 
sequential  moderation. 

In  conclusion,  the  analytic  procedures  presented  here  do  not  exhaust 
the  tests  that  might  be  conducted  in  subgrouping  or  sequential  moderator  anal¬ 
ysis.  For  example,  tests  for  differences  in  intercepts  were  not  addressed. 


Moderator 


26 

Tests  for  differences  in  intercepts  are  available  in  Timm  (1975)  for  the 
overall  tests  on  independent  subgroups  (analogues  of  Equations  1  and  4), 
and  with  minor  extension  the  logic  can  be  applied  to  the  multiple  comparison 
test  (Equation  3).  Other  tests  that  might  be  of  interest  include  (a)  planned 
comparisons  for  subgrouping  moderator  analysis,  (b)  tests  of  intercepts, 
post  hoc  multiple  comparisons,  and  planned  comparisons  for  the  sequential  mod¬ 
eration  designs,  (c)  tests  involving  multiple  criteria  in  sequential  mod¬ 

eration  designs,  and  (d)  tests  which  contrast  the  efficacy  of  different  mod¬ 
erators  in  both  subgrouping  and  sequential  moderator  analyses.  Additional 
work  is  required  to  develop  these  tests,  although  James,  Hater,  and  Jones 
(Note  1)  have  proposed  a  planned  comparison  test  for  subgrouping  moderator 


analysis. 
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An  exception  is  a  study  by  Stone,  Mowday,  and  Porter  (1977),  which  employed 
a  chi-square  test  to  assess  the  equality  of  three  correlation  coefficients 
provided  by  three  subgroups. 
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See  also  articles  by  Malgady  and  Huck  (1978),  McLaughlin  (1975),  and  Werts, 
Rock,  Linn,  and  Joreskog  (1976). 
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Our  programs,  which  are  written  in  APL  and  available  from  the  authors,  were 
checked  against  data  presented  in  Timm  (1975).  These  data  were  not  used 
here  because  only  two  subgroups  were  employed,  and  it  was  our  desire  to 

illustrate  the  procedures  with  more  than  two  subgroups. 
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Table  1 

Illustrative  Data  and  Descriptive  Statistics  for  Three  Subgroups 
Two  Criteria  and  Two  Predictors 
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-4 

1 

1 

4 

4 

15 

5 

4 

5 

4 

5 

4 

4 

.4 

1 

7 

5 

4 

Statistics 


M 

3.13 

3.07 

2.93  3.47 

3.20 

3. 13 

3. 33  3.73 

2.93 

2.87 

3.00  3.53 

SD 

1.36 

1.10 

1.39  1.46 

1.32 

1.06 

1.68  1.62 

1.33 

1.13 

1.31  1.46 

rx  X 

1  2 

.33 

.29 

.37 

Va 

.69* 

.  80** 

.64* 

Vi 

.76* 

.47 

.32 

.  13 

-.69* 

-.48 

Va 

.58* 

.34 

.26 

.02 

-.53* 

-.35 

R  * 

yl 

.80*  .60 

.33  .27 

.74*  .55 

a 

Multiple  correlation  based  on  the  regression  of  each  criterion  on  two  predictors  in  each  subgroup. 


p  <  .05 


I.'oderator 


Table  2 

Statistical  Information  Required  for  Multivariate  and  Univariate 
Tests  of  Parallelism  on  Three  Independent  Subgroups 


Moderator 
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Table  1 

Results  of  Tests  of  Parallelism,  a  General  Predictor,  and  a  Multiple 
Comparison  for  Independent  Subgroups 


I.  Test  of  Parallelism  across  Three  Subgroups  Based  on  Two  Criteria 

Source-Residual  Determinant  Value  if_  (U-test) 

Qe  2592.66  .63*  (2,4,  36) 

Qc  4121.07 


II.  Tests  of  Parallelism  for  Each  of  Two  Criteria,  Across  Three  Subgroups 


Criterion 

Degrees  of  Freedom 

Y 

y 

Common  Weights 

4 

4 

Unique  Weights 

36 

Mean  Square-Residual 

Common  Weights 

8.02 

5.29 

Unique  Weights 

1.55 

2.05 

F 

5.17** 

2.58 

III.  Test  to  Ascertain  if  predictor  X;  Contributed 

to  Nonparallelism 

for  the  Y;  Criterion 

Source-Residual 

d f 

MS  F 

Weighted  Mean 

-> 

a. 

*** 

14.57  9.66 

Unique  Weights 

36 

1.51 

IV.  Comparison  of  Subgroup  1 

and  Subgroup  3  Based 

on  b-weights  for 

the  Y,  Criterion 

Source-Residual 

df 

MS  F 

Common  Weights  Based 

on  Two  Groups 

■> 

15.00  9.66 

Unique  Weights 

36 

1.55 

Note.  The  ^-values  are  as  follows:  *  .05.  **  .025,  ***  .01,  ****  .001/  . 


Table  4 


Moderator 


a 


b 


Maaaured  at  tint  T 

0 


V  aaaaured  at  tlae  T 

1 


c 


Y  Matured  at  tlM  T 

_2 


Moderator 


Table  5  33 

Descriptive  Statistics,  Statistical  Information  Required  for  Test  of 
Parallelism,  and  Results  of  Test  of  Parallelism  for 
Sequential  Moderation 


Deviations . 

and  Correlations 

X 

X 

Y 

M 

SD 

_1 

_2 

_1 

- 

5.30 

2.69 

.33 

- 

6.10 

2.36 

.84** 

.28 

- 

5.17 

2.63 

,38* 

.  78** 

.40* 

6.57 

2.17 

XI.  Statistical  Information  Required  for  Test  of  Parallelism 


[7.21  2.07 

2.07  5.56  1 

[•■"] 


-l£  f  1 

VC  -  .16  -.06 

xx  £-.06  .20J 

Dn] 


r 5,95 1 

c 

-  r 2.231 

11.72 1 

xy 

4.01 

L  J 

_ 2 

L.  _J 

B  -  |.82  I 

_!  [.00j 


[a] 


III.  Test  of  Parallelism  for  Two  Predictor  and  Two  Measurements  on  One  Criterion 

Source  Determinant  Value  A 

_1 

Q  .0003  .04** 


Q  Q 
E  ♦  H 


Identical  for  s  -  1,  2?  SS  -  n  VC  and  SS  *  1  -  i  VC  _1 . 

*  XX  XX  n  XX 


Based  on  average  of  3  and  B  , 

1  2 


L 


D-0 


[s] 


(2,  2,  25) 


£  *  .03 

£  <  .01 


Moderator 


Subgroup 


Criterion  Yf 

Al 

a2 

Predictor  X-j 

r111 

r112 

Predictor  X2 

r121 

r122 

Predictor  X3 

r131 

r132 

Criterion  Y2 

Predictor  X-j 

r211 

r212 

Predictor  X2 

r221 

r222 

Predictor  X3 

r231 

r232 

i 


Moderator 


Criterion  Yf 

Predictor  Xf 

Predictor  X2 

*  -  - 

Predictor  Xj 
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Subgroup 


A1 

A2 

••  Ak 

...  ak 

- 

b111 

b112 

••  b11k 

...  b11K 

b121 

• 

b122 

b12k 

...  b12K 

hjl 

• 

b1  j  2 

• 

•  b1jk 

• 

• 

•  ^IjK 

^J1 

♦ 

b1J2 

• 

•  b1  jk 

• 

• 

•  b1JK 

Predictor  Xj 


Moderator 


Predictors  at  T0  T-j 


Xl_ 

b11 

X2 

• 

• 

• 

b12 

• 

• 

• 

Xj_ 

bH 

0 

• 

Xj 

b1J 
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Time 


li 

...  Ts 

...  Tg 

b21 

...  bs^ 

...  bS1 

t>22 

• 

"•  bs2 
• 

...  bS2 
• 

b2j 

• 

• 

• 

...  bSj 
• 

• 

• 

•••  bSj 
• 

• 

b2J 

• 

• 

•••  bsJ 

• 

• 

•••  bSj 

Hod era cor 
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Figure  1. 


An  illustration  of  a  typical  analytic  model  for  subgrouping 
moderator  analysis.  Subscripts  for  the  correlation  coeffi¬ 
cients,  r  ,  are:  i^  =*  1,2  criteria,  *  1,2,3  predictors. 


k  *  1,2  subgroups. 


Figure  2.  An  illustration  of  an  analytic  model  for  tests  of  independent 
subgroups. 

Figure  3.  An  illustration  of  an  analytic  model  for  a  test  of  sequential 
moderation.  The  ^-weights  refer  to  predictor-criterion 
relationships  for  repeated  measurements  on  the  same  criterion. 


